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1 3  ABSTRACT  (Maximum  200  words) 

The  objective  of  this  research  is  the  development  of  a  low  cost  sensor  system  with  applications  in  biometric  tracking  and  authentication.  We  have  demonstrated  the 
ability  to  classify  and  track  human  motion  using  tow  cost,  off-  the-sheif  pyroelectric  detectors.  We  have  designed  ficldabk-  sensor  units  that  are  anonymous  and  can 
perform  multiple  tasks  such  as  biometric  ebwrifea&m.  multiple  object  tracking,  and  camera  pointing.  We  have  demonstrated  the  ability  to  track  two  individuals  and 
demonstrated  the  ability  to  recognize  multiple  humans  with  an  accuracy  of  86%.  We  have  integrated  the  units  through  wireless  communication  to  allow  the  creation  of 
a  cluster  field  of  detectors. 
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Statement  of  the  problem 

We  propose  the  development  of  a  low  cost  sensor  system  that  has  potential  applications  in 
biometric  tracking  and  authentication.  Our  target  application  is  to  classify  human  motion  using  low 
cost,  off-  the-shelf  pyroelectric  detectors,  that  will  be  anonymous  and  can  perform  multiple  tasks 
such  as  biometric  classification,  camera  pointing,  and  integration  with  other  sensor  modalities  such 
as  acoustics  to  provide  an  integrated  cluster  field  of  detectors. 


Summary  of  the  most  important  results 


Conventional  biometrics  implementations  involve  the  use  of  cameras  or  infrared  imagers  to  gather  either 
brief,  high  resolution  measurements  in  the  case  of  retinal  or  iris  scanners,  or  short  range,  low  bandwidth 
measurements  as  with  fingerprint  or  gait  recognition  algorithms.  Biometrics  are  principally  for  local 
authentication  and  often  sacrifice  bandwidth  and  computational  efficiency  for  low  false-positive 
detection,  tracking  applications  on  the  other  hand,  are  designed  for  longer  range  operation  and  trade 
resolution  for  field  of  view.  Our  unique  approach,  that  allows  us  to  accomplish  the  research  objective,  is 
the  use  of  coded  apertures  which  spatially  modulate  the  sensors  visibility. 

We  have  designed  and  developed  a  low-cost  pyroelectric  detector  based  IR  motion-tracking  system.  Our 
approach  is  novel  in  its  emphasis  on  integrated  computational  sensors,  in  its  attention  to  sensor  sampling 
topology,  system  geometries,  data  efficiency  and  computational  complexity  and  in  its  integration  of 
heterogeneous  sensor  modalities.  We  have  developed  reference  structure  based  thermal  infrared  sensors. 
A  single  platform  has  eight  pyroelectric  detectors  accompanied  with  Fresnel  lens  arrays,  an  amplifier 
board,  and  an  integrated  micro-controller/transceiver  board  for  on-board  processing  and  wireless 
communication.  The  sensors  have  been  designed  to  sample  human  visual  signatures  according  to 
algorithmically  matched  geometries.  We  have  studied  the  characteristics  of  the  detector  and  the  Fresnel 
lenses  that  are  used  to  modulate  the  visibility  of  the  detectors.  The  optimal  element  number  of  the  lens 
array  for  the  identification  system  was  investigated  and  the  experimental  results  suggest  that  the  lens 
array  with  more  elements  can  yield  a  better  performance  in  terms  of  identification  and  false  alarm  rates. 
The  other  parameters  of  the  system  configuration  such  as  the  height  of  sensor  location  and  sensor-to- 
object  distance  were  also  studied  to  improve  spectral  distinctions  among  sensory  data  of  human  objects. 

A  theory  has  been  developed  to  guide  in  the  design  of  spatial  mappings  for  segmenting  a  tracking  space. 
The  map  allows  the  use  of  boundary  sensor  arrays  for  object  tracking.  Analysis  of  both  ID  and  2D 
spaces  based  on  graph  theory  has  been  made. 

To  accomplish  classification  of  motion,  to  sort  people  into  groups,  and  to  classify  the  tasks  they  are 
performing,  we  have  used  two  approaches  using  the  mapping  patterns  generated  by  the  spatially 
visibility  maps.  In  the  first  approach  the  temporal  signal  produced  by  the  detector  is  represented  by  an 
n-dimensional  vector  whose  length  is  associated  with  the  temporal  duration  of  the  detector  signal  but 
whose  components  are  based  on  features  of  the  temporal  signal.  In  the  second  approach,  frequency 
analysis  of  the  temporal  signals  has  been  used  to  classify  the  motion  of  people  into  classes. 

We  have  developed  algorithms  and  sensor  distribution  and  sampling  design  and  placed  them  in  a  testbed 
facility  on  the  Duke  campus.  The  sensors  have  been  designed  to  work  in  heterogeneous  arrays  covering 
a  large  indoor  area.  We  have  demonstrated  the  ability  to  track  a  two  individuals  in  an  enclosed  room 
using  two  different  sensor  designs.  We  have  also  demonstrated  the  ability  to  identify  multiple  humans 
with  a  success  rate  of  86%.  In  the  frequency  analysis  approach  the  recognition  was  accomplished  using 
Principal  component  analysis  of  the  spectral  content  of  the  tracking  signals.  The  detector  array  with 
masked  Fresnel  lens  arrays  was  also  used  to  generate  digital  sequential  data  that  can  represent  a  human 


motion  feature.  Hidden  Markov  models  (HMMs)  were  trained  to  statistically  model  the  motion  features 
of  individuals  through  an  expectation-maximization  (EM)  learning  process.  Human  subjects  were 
recognized  by  evaluating  a  set  of  new  feature  data  against  the  trained  HMMs  using  the  maximum- 
likelihood  (ML)  criterion. 

We  have  also  been  able  to  recognized  the  performance  of  different  tasks  by  an  individual. 
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